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DETAILED ACTION 

1 . This communication is responsive to Amendment, filed 1 1/27/2007. 

Claims 1-2, 7-23, 28-33, 37-38, 40-41 are pending in this application. Claims 1, 22, 37, 
38, 40-41 are independent claims. In the Amendment, claims 1, 9, 22, 30, 37, 38, 40, 41 have 
been amended. This action is made non-Final due to the 101 rejection should have been made 
in the previous action. 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title, 

3. Claims 37, 38 are rejected under 35 U.S.C. § 101 because the claimed invention is 
directed to non-statutory subject matter. 

Claim 37 recites "An apparatus... comprising: media file generation...; index file 
generation. . and Applicant has invoked 112, 6th paragraph by using means plus fimction 
language; however, each of the means is reasonably interpreted in view of the specification as 
just software as the means for performing the recited fimction appears to be computer program 
modules (i.e. The process 500 is preferably implemented ais software. Specification, page 11, line 
23). Thus the body of the claim does not define any specific hardware (i.e. a processor, memory) 
to execute the recited computer program modules. Therefore, the claimed apparatus is not 
limited to embodiments which include the hardware necessary to enable any underlying 
fimctionality to be realized. The claim lacks the necessary physical articles or objects to 
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constitute a machine or a manufacture within the meaning of 35 U.S.C. § 101, instead being 
software per se. See MPEP 2106.01 . 

Claim 38 recites "An apparatus... comprising: media file generation...; index file 
generation. . and Applicant has invoked 112, 6th paragraph by using means plus ftinction 
language; however, each of the means is reasonably interpreted in view of the specification as 
just software as the means for performing the recited function appears to be computer program 
modules (i.e. The process 500 is preferably implemented as software. Specification, page 11, line 
23). Thus the body of the claim does not define any specific hardware (i.e. a processor, memory) 
to execute the recited computer program modules. Therefore, the claimed apparatus is not 
limited to embodiments which include the hardware necessary to enable any underlying 
fimctionality to be realized. The claim lacks the necessary physical articles or objects to 
constitute a machine or a manufacture within the meaning of 35 U.S.C. § 101, instead being 
software per se. See MPEP 2 1 06.0 1 . 

Claim Rejections ' 35 use § 103 
4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the claims 

under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various claims 
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was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point 
out the inventor and invention dates of each claim that was not commonly owned at the time 
a later invention was made in order for the examiner to consider the applicability of 35 
U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 

5. Claims 1, 2, 7-10, 12-15, 17, 18, 22, 23, 28-31, 33, 37, 38, 40, 41 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Pan et al. (US Patent No. 6,993,246), in view of Lyle 
(US Patent No. 6,470,359), and further in view of Nunally et al. (US Patent No. 6,035,341). 

As per claim 1, Pan teaches a method of storing data, said method comprising the steps 

of: 

storing data (i.e. video and audio data^ is stored on a hard disk, col 4, lines 58-65), as one 
or more data samples (i.e. a sequence of video and audio frames, col i, lines 20-27 ; event el, ... 
event e6; event fl .... event f5; See Fig. 2), in one or more media files (le. Data stream #1, Data 
stream #2 in Fig. 2; a digital file, col 7, line 59 to col 2, line 5) configured for use by a media 
player application (i.e. a media file that can be played back through an application such as 
Microsoft Windows Media Player, col 3, lines 20-27) in playing the data samples (i.e. a ''data 
stream" is a sequence of video and audio frames read from a media file that can be played back 
through an application such as Microsoft Windows Media Player, col 3, lines 20-27); 

storing, in an index file (i.e. a data set is maintained in an index file, col 2, lines 11-26) 
associated with one or more the media files, at least an offset value (le. positional information, 
col 1, line 59 to col 2, line 5) for each of the data samples representing a location (i.e. positional 
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information indicating where data associated with the events are located in a corresponding 
storage medium such as a digital file or where the data is located within the data stream, col 7, 
line 59 to col 2, line 5) of each of the data samples in a corresponding one of the media files, 
each of the media files further comprising additional information (i.e, data pointer, time, See Fig. 
2) interspersed throughout that media file (le, correlating data among multiple data streams 
based on a use of time-stamps and related positional information, col 1, lines 46-58; See Fig. 2), 
the additional information comprising at least a timestamp (i.e. the time-stamps are used as an 
index to locate where the data associated with the corresponding event is stored in the second 
data stream, col 2, lines 27-40) for each of the data samples (le. event el, ... event e6; event fl 
.... event f5; See Fig. 2), each of the timestamps (le. tl, t3, tlO, t6, t8, til, t2, t4, t5, t7, t9; See 
Fig. 2) indicating a capture time of an associated data sample (le. During a presentation of 
information at slide display device 580, an audio-video recording unit 585 captures details of, 
for example, a corresponding slide presentation including a lecturer delivering a speech. A data 
stream generated by the audio-video recording unit 585 is captured for storage in a data file at 
data processing unit 560, col 10, lines 39-51). 

It should be note that Pan teaches the additional information of the media file is used in 
constructing the index file as showed in Fig. 2 (le. a data set is maintained in an index file, col 
2, lines 11-26; The resulting event-data pointer record 152, (E.subA,j,P.sub.i,j,T.sub.i,j), is then 
stored in a data stream index file #1 235. There is usually one index file for each data stream, 
Pan, col 4, lines 34-39), wherein the data set of Pan comprises Event E (data sample of the 
claimed limitation), Pointer P (additional information of the claimed limitation), Timestamp T 
(additional information of the claimed limitation). 
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The index file of Pan fiirther comprises the offset values (i.e. positional information, col. 
7, line 59 to col. 2, line 5) representing the location of each of the data samples in the media files 
(i.e. positional information indicating where data associated with the events are located in a 
corresponding storage medium such as a digital file or where the data is located within the data 
stream, col 7, line 59 to col. 2, line 5). 

Pan does not explicitly teach: 

the additional information of the media files being used in reconstructing the index file 
upon corruption of the index file, the reconstructed index file comprising the offset values 
representing the location of each of the data samples in the media files, wherein the reconstructed 
index file replaces the index file associated with the one or more media files. 

Lyle teaches: 

the additional information (i.e. additional information within a space map page in a LOB 
table space, col 4, line 60 to col J, line 6) of the media files (Le. LOB, Large objects, such as 
image data, col 2, lines 27-37) being used in reconstructing the index file (le. to recover an 
index on an auxiliary table by reading only the LOB low-level space map pages, col 4, line 60 to 
col 5, line 6) upon corruption of the index file (i.e. the index could be corrupted, col 2, lines 38- 
44), the reconstructed index file comprising the offset values (i.e. the index recovery system 124 
indicates for each page in the space map page whether that page is the first page allocated to a 
LOB, col 4, line 60 to col 5, line 6) representing the location of each of the data samples in the 
media files (le. The index recovery system 124 of the present invention includes additional 
information within a space map page in a LOB table space. In addition to recording whether a 
page is allocated or deallocated, the index recovery system 124 indicates for each page in the 
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space map page whether that page is the first page allocated to a LOB, Storing this information 
with a LOB low-level space map page enables the index recovery system 124 to recover an index 
on an auxiliary table by reading only the LOB low-level space map pages, instead of all pages in 
the LOB table space, col 4, line 60 to col 5, line 6), 

It should be noted that the claimed invention discloses using additional information such 
as image information to reconstruct the index file (i.e. said image information allows for 
reconstruction of said index file upon corruption thereof, See Application, [0017]). Similarly, 
Lyle teaches usirig of additional information such as image information to rebuild the index. 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan 
and Lyle at the time the invention was made to modify the system of Pan to include the 
limitations as taught by Lyle. One of ordinary skill in the art would be motivated to make this 
combination in order to recover an index on an auxiliary table in view of Lyle (col. 4, line 60 to 
col. 5, line 6), as doing so would give the added benefit of enabling the index recovery system 
124 to recover an index on an auxiliary table by reading only the LOB low-level space map 
pages, instead of all pages in the LOB table space as taught by Lyle (col. 4, line 60 to col. 5, line 
6). 

Pan, Lyle do not explicitly teach the reconstructed index file replaces the index file 
associated with the one or more media files. 

Nunally teaches the step of updating the index information for video and audio files (Le. 
the sequence is added to a positive result list (step 152) and the index information for the file is 
updated to indicate detection of the event (step 154). That is, the event-related data shown at 104 
in FIG, 5 is updated to indicate detection of the event, as well as the confidence factor applicable 
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to the event detection decision, col, 10, lines 37-62; FIG. 5 illustrates a format in which 
compressed video and audio data are stored on one or more of the hard disk drives of the 
analysis/storage device. As seen from FIG. 5, the data stored on the hard drives includes 
compressed video and audio data files indicated generally at 92 and index data indicated 
generally at 94, col. 8, line 66 to col. 9, line 14). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally at the time the invention was made to modify the system of Pan, Lyle to include 
the limitations as taught by Nunally. One of ordinary skill in the art would be motivated to make 
this combination in order to update the index information for video and audio files in view of 
Nunally (col. 10, lines 37-62), as doing so would give the added benefit of providing an 
integrated video and audio recording device with advanced information management capabilities 
as taught by Nunally (col. 1 , lines 37-39). 

As per claim 22, Pan teaches a method of storing video (i.e. video frames,' col 11, lines 
45-52) and associated text data (i.e. textual data stream, col. 11, lines 16-34), said method 
comprising the steps of: 

storing the video (i.e. video and audio data is stored on a hard disk, col. 4, lines 58-65) 
associated text data (i.e. textual data stream, col. 11, lines 16-34), as one or more data samples 
(i.e. a sequence of video and audio frames, col. 3, lines 20-27; event el, ... event e6; event fl .... 
event f5; See Fig. 2), in one or more media files in accordance with first file format (i.e. closed 
captions for video or audio content, col. 11, lines 15-23; Another aspect of the present invention 
involves correlating more than two data streams and storing related time-stamped event data 
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pointers to a storage device for later retrieval As previously mentioned, the time-stamps indicate 
a reference time when a particular event was detected while a corresponding data pointer 
indicates a location where data associated with that event was stored in the data file, col 2, lines 
58-64), each media file being configured for use by a media file player application in playing the 
video data (le. video playback system, col 11, lines 45-52); 

storing, in a index file (le, a data set is maintained in an index file, col 2, lines 11-26) in 
accordance with a second file format (Le, audio samples, col 11, lines 45-52), at least an offset 
value for each of the data samples (7.e. a sequence of video and audio frames, col 3, lines 20-27; 
event el, ... event e6; event fl .... event f5; See Fig. 2) representing a location of each of the one 
or more data samples in a corresponding one of the media files (Le, Another aspect of the present 
invention involves correlating more than two data streams and storing related time-stomped 
event data pointers to a storage device for later retrieval As previously mentioned, the time- 
stamps indicate a reference time when a particular event was detected while a corresponding 
data pointer indicates a location where data associated with that event was stored in the data 
file, col 2, lines 58-64); and 

adding additional information (Le. data pointer, time. See Fig. 2) interspersed throughout 
each of the media files (Le. correlating data among multiple data streams based on a use of 
time-stamps and related positional information, col 1, lines 46-58), the media files including the 
additional information being readable by a media player application (Le. a media file that can be 
played back through an application such as Microsoft Windows Media Player, col 3, lines 20- 
27) corresponding at least to first file format (Le. video playback system ... a standard media 
player, col 11, lines 45-52), the additional information comprising at least a timestamp (Le. the 
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time-stamps are used as an index to locate where the data associated with the corresponding 
event is stored in the second data stream, col, 2, lines 27-40) for one or more of the data samples 
(i.e. a sequence of video and audio frames, col. 3, lines 20-27; event el, ... event e6; event fl 
event f5; See Fig. 2), each of the timestamps indicating a capture time (i.e. tl, t3, tlO, t6, t8, til, 
t2, t4, t5, t7, t9; See Fig. 2) of an associated data sample (i.e. The principles of the present 
invention have applications beyond note taking, text entry, or a close captioning system. One 
example is a video surveillance system for an automobile parking lot. This example system uses 
multiple video cameras. One set of cameras record the automobiles and associated license plates 
at the entrance and exits. Another set of cameras record the parking area. In current video 
surveillance systems, cameras continuously record video on tape. This results in a waste of video 
recording media. A more efficient system would record, for example, only for a few seconds after 
a motion detector indicates when a car has entered or left the garage or parking space. This type 
of sporadic recording renders it difficult to determine where an event is recorded on a videotape. 
Even a time-stamped videotape must be searched for the appropriate time match, col 13, line 62 
to col. 14, line 9). 

It should be note that Pan teaches the additional information of the media file is used in 
constructing the index file as showed in Fig. 2 (i.e. a data set is maintained in an index file, col. 
2, lines 11-26; The resulting event-data pointer record 152, (E.sub.iJ,P.sub.i,j,T.sub.i,j), is then 
stored in a data stream index file #1 235. There is usually one index file for each data stream. 
Pan, col. 4, lines 34-39), wherein the data set of Pan comprises Event E (data sample of the 
claimed limitation), Pointer P (additional information of the claimed limitation), Timestamp T 
(additional information of the claimed limitation). 
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The index file of Pan further comprises the offset values (Le. positional information, col 
7, line 59 to col 2, line 5) representing the location of each of the data samples in the media files 
(le, positional information indicating where data associated with the events are located in a 
corresponding storage medium such as a digital file or where the data is located within the data 
stream, col 7, line 59 to col 2, line 5), 

Pan does not explicitly teach: 

the additional information of the media files being used in reconstructing the index file 
upon corruption of the index file, the reconstructed index file comprising the offset values 
representing the location of each of the data samples in the media files, wherein the reconstructed 
index file replaces the index file associated with the one or more media files. 

Lyle teaches: 

the additional information. (7. e. additional information within a space map page in a LOB 
table space, col 4, line 60 to col 5, line 6) of the media files (le. LOB, Large objects, such as 
image data, col 2, lines 27-37) being used in reconstructing the index file (i.e. to recover an 
index on an auxiliary table by reading only the LOB low-level space map pages, col 4, line 60 to 
col 5, line 6) upon corruption of the index file (i.e. the index could be corrupted, col 2, lines 38- 
44), the reconstructed index file comprising the offset values (le. the index recovery system 124 
indicates for each page in the space map page whether that page is the first page allocated to a 
LOB, col 4, line 60 to col 5, line 6) representing the location of each of the data samples in the 
media files (le. The index recovery system 124 of the present invention includes additional 
information within a space map page in a LOB table space. In addition to recording whether a 
page is allocated or deallocated, the index recovery system 124 indicates for each page in the 
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space map page whether that page is the first page allocated to a LOB, Storing this information 
with a LOB low-level space map page enables the index recovery system 124 to recover an index 
on an auxiliary table by reading only the LOB low-level space map pages, instead of all pages in 
the LOB table space, col 4, line 60 to col 5, line 6), 

It should be noted that the claimed invention discloses using additional information such 
as image information to reconstruct the index file (i.e. said image information allows for 
reconstruction of said index file upon corruption thereof, See Application, [0017]). 

Similarly, Lyle teaches using of additional information such as image information to 
rebuild the index. 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan 
and Lyle at the time the invention was made to modify the system of Pan to include the 
limitations as taught by Lyle. One of ordinary skill in the art would be motivated to make this 
combination in order to recover an index on an auxiliary table in view of Lyle (col. 4, line 60 to 
col. 5, line 6), as doing so would give the added benefit of enabling the index recovery system 
124 to recover an index on an auxiliary table by reading only the LOB low-level space map 
pages, instead of all pages in the LOB table space as taught by Lyle (col. 4, line 60 to col. 5, line 
6). 

Pan, Lyle do not fairly teach the reconstructed index file replaces the index file associated 
with the one or more media files. 

Nunally teaches the step of updating the index information for video and audio files (i.e, 
the sequence is added to a positive result list (step 152) and the index information for the file is 
updated to indicate detection of the event (step 154). That is, the event-related data shown at 104 
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in FIG, 5 is updated to indicate detection of the event, as well as the confidence factor applicable 
to the event detection decision, col 10, lines 37-62; FIG, 5 illustrates a format in which 
compressed video and audio data are stored on one or more of the hard disk drives of the 
analysis/storage device. As seen from FIG, 5, the data stored on the hard drives includes 
compressed video and audio data files indicated generally at 92 and index data indicated 
generally at 94, col, 8, line 66 to col, 9, line 14). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally at the time the invention was made to modify the system of Pan, Lyle to include 
the limitations as taught by Nunally. One of ordinary skill in the art would be motivated to make 
this combination in order to update the index information for video and audio files in view of 
Nunally (col. 10, lines 37-62), as doing so would give the added benefit of providing an 
integrated video and audio recording device with advanced information management capabilities 
as taught by Nunally (col. 1, lines 37-39). 

As per claim 37, Pan teaches an apparatus for storing data, said apparatus comprising of: 
media file generation means for storing data (I e, video and audio data is stored on a hard 
disk, col 4, lines 58-65), as one or more data samples (i,e, a sequence of video and audio frames, 
col 3, lines 20-27; event el, ... event e6; event fl .... event f5; See Fig, 2), in one or more media 
files (le. Data stream #1, Data stream #2 in Fig. 2; a digital file, col 1, line 59 to col 2, line 5) 
configured for use by a media player (i.e. a media file that can be played back through an 
application such as Microsoft Windows Media Player, col 3, lines 20-27) application in playing 
the data samples (Le. a *'data stream'* is a sequence of video and audio frames read from a media 
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file that can be played back through an application such as Microsoft Windows Media Player, 
col i, lines 20-27 )\ and 

index file generation means for storing, in an index file (le, a data set is maintained in an 
index file, col 2, lines 11-26) associated with one or more the media files, at least an offset value 
(i.e. positional information, col 7, line 59 to col 2, line 5) for each of the data samples 
representing a location (Le. positional information indicating where data associated with the 
events are located in a corresponding storage medium such as a digital file or where the data is 
located within the data stream, col 1, line 59 to col 2, line 5) of each of the data samples in a 
. corresponding one of the media files, each of the media files ftirther comprising additional 
information (7. data pointer, time. See Fig, 2) interspersed throughout that media file (le. 
correlating data among multiple data streams based on a use of time-stamps and related 
positional information, col 1, lines 46-58; See Fig, 2), the additional information comprising at 
least a timestamp (i.e. the time-stamps are used as an index to locate where the data associated 
with the corresponding event is stored in the second data stream, col 2, lines 27-40) for each of 
the data samples (le, event el, ... event e6; event fl .... event fi; See Fig. 2), each of the 
timestamps (le. tl, t3, tlO, t6, t8, til, t2, t4, t5, t7, t9; See Fig 2) indicating a capture time of an 
associated data sample (le. During a presentation of information at slide display device 580, an 
audio-video recording unit 585 captures details of for example, a corresponding slide 
presentation including a lecturer delivering a speech. A data stream generated by the audio- 
video recording unit 585 is captured for storage in a data file at data processing unit 560, col 
10, lines 39-51), 
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It should be note that Pan teaches the additional information of the media file is used in 
constructing the index file as showed in Fig. 2 (Le, a data set is maintained in an index file, col 
2, lines 11-26; The resulting event-data pointer record 152, (E.subJj\RsubJj\T.sub.iJ), is then 
stored in a data stream index file #1 235. There is usually one index file for each data stream, 
Pan, col 4, lines 34-39), wherein the data set of Pan comprises Event E (data sample of the 
claimed limitation), Pointer P (additional information of the claimed limitation), Timestamp T 
(additional information of the claimed limitation). 

The index file of Pan further comprises the offset values (le, positional information, col 
1, line 59 to col 2, line 5) representing the location of each of the data samples in the media files 
(i.e, positional information indicating where data associated with the events are located in a 
corresponding storage medium such as a digital file or where the data is located within the data 
stream, col 1, line 59 to col 2, line 5). 

Pan does not explicitly teach: 

the additional information of the media files being used in reconstructing the index file 
upon corruption of the index file, the reconstructed index file comprising the offset values 
representing the location of each of the data samples in the media files, wherein the reconstructed 
index file replaces the index file associated with the one or more media files. 

Lyle teaches: 

the additional information (le, additional information within a space map page in a LOB 
table space, col 4, line 60 to col 5, line 6) of the media files (le, LOB, Large objects, such as 
image data, col 2, lines 27-37) being used in reconstructing the index file (i,e, to recover an 
index on an auxiliary table by reading only the LOB low-level space map pages, col 4, line 60 to 



Application/Control Number: Page 16 

10/748,334 

Art Unit: 2167 

col J, line 6) upon corruption of the index file (le, the index could be corrupted, col 2, lines 38- 
44) y the reconstructed index file comprising the offset values (Le. the index recovery system 124 
indicates for each page in the space map page whether that page is the first page allocated to a 
LOB, col 4, line 60 to col 5, line 6) representing the location of each of the data samples in the 
media files (Le. The index recovery system 124 of the present invention includes additional 
information within a space map page in a LOB table space. In addition to recording whether a 
page is allocated or deallocated, the index recovery system 124 indicates for each page in the 
space map page whether that page is the first page allocated to a LOB. Storing this information 
with a LOB low-level space map page enables the index recovery system 124 to recover an index 
on an auxiliary table by reading only the LOB low-level space map pages, instead of all pages in 
the LOB table space, col 4, line 60 to col 5, line 6), 

It should be noted that the claimed invention discloses using additional information such 
as image information to reconstruct the index file (said image information allows for 
reconstruction of said index file upon corruption thereof, See Application, [0017]). 

Similarly, Lyle teaches using of additional information such as image information to 
rebuild the index. 

Thus, it would have been obvious to one of ordinary skill of the art having the teaching of 
Pan and Lyle at the time the invention was made to modify the system of Pan to include the 
limitations as taught by Lyle. One of ordinary skill in the art would be motivated to make this 
combination in order to recover an index on an auxiliary table in view of Lyle (col. 4, line 60 to 
col. 5, line 6), as doing so would give the added benefit of enabling the index recovery system 
124 to recover an index on an auxiliary table by reading only the LOB low-level space map 
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pages, instead of all pages in the LOB table space as taught by Lyle (col. 4, line 60 to col. 5, line 
6). 

Pan, Lyle do not fairly teach the reconstructed index file replaces the index file associated 
with the one or more media files. 

Nunally teaches the step of updating the index information for video and audio files (le, 
the sequence is added to a positive result list (step 152) and the index information for the file is . 
updated to indicate detection of the event (step 154). That is, the event-related data shown at 104 
in FIG. 5 is updated to indicate detection of the event, as well as the confidence factor applicable 
to the event detection decision, col 10, lines 37-62; FIG. 5 illustrates a format in which 
compressed video and audio data are stored on one or more of the hard disk drives of the 
analysis/storage device. As seen from FIG. 5, the data stored on the hard drives includes 
compressed video and audio data files indicated generally at 92 and index data indicated 
generally at 94, col 8, line 66 to col 9, line 14). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally at the time the invention was made to modify the system of Pan, Lyle to include 
the limitations as taught by Nunally. One of ordinary skill in the art would be motivated to make 
this combination in order to update the index information for video and audio files in view of 
Nxmally (col. 10, lines 37-62), as doing so would give the added benefit of providing an 
integrated video and audio recording device with advanced information management capabilities 
as taught by Nunally (col. 1, lines 37-39). 
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As per claim 38, Pan teaches an apparatus for storing video data and associated text data 
(Le, textual data stream, col. 11, lines 16-34), said apparatus comprising of: 

media file generation means for storing the video data (le, video and audio data is stored 
on a hard disk, col 4, lines 58-65) and associated text data (i,e. textual data stream, col 11, lines 
16-34), as one or more data samples (le, a sequence of video and audio frames, col 3, lines 20- 
27; event el, ... event e6; event fl .... event f5; See Fig. 2), in one or more media files in 
accordance with a first file format (i.e. Data stream #1, Data stream #2 in Fig. 2; a digital file, 
col 1, line 59 to col 2, line 5), each media file configured for use by a media player application 
(Le. a media file that can be played back through an application such as Microsoft Windows 
Media Player, col 3, lines 20-27) in playing the video data (Le. a *'data stream" is a sequence of 
video and audio frames read from a media file that can be played back through an application 
such as Microsoft Windows Media Player, col 3, lines 20-27); 

index file generation means for storing in an index file in accordance with a second file 
format /z.e. a data set is maintained in an index file, col 2, lines 11-26), at least an offset value 
(le, positional information, col 1, line 59 to col 2, line 5) for each of the data samples 
representing a location of each of the one or more data samples in a corresponding one of the 
media files (le. positional information indicating where data associated with the events are 
located in a corresponding storage medium such as a digital file or where the data is located 
within the data stream, col 1, line 59 to col 2, line 5); and 

image information adding means (le. informational data set is generated and stored in 
an index file. Abstract) for adding additional information (le. data pointer, time, See Fig. 2) 
interspersed throughout each of the media files (Le. correlating data among multiple data 
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streams based on a use of time-stamps and related positional information, col 7, lines 46-58; 
See Fig. 2), the media file comprising the additional information being readable by the media 
player application corresponding at least to the first file format (i.e. a media file that can be 
played back through an application such as Microsoft Windows Media Player, col 3, lines 20- 
27), the additional information comprising at least a timestamp (i.e. the time-stamps are used as 
an index to locate where the data associated with the corresponding event is stored in the second 
data stream, col 2, lines 27-40) for one or more data samples (le. event el, ... event e6; event fl 
.... event f5; See Fig. 2), each of the timestamps (i.e. tl, t3, tlO, t6, t8, til, t2, t4, t5, t7, t9; See 
Fig. 2) indicating a capture time of an associated data sample (Le. During a presentation of 
information at slide display device 580, an audio-video recording unit 585 captures details of 
for example, a corresponding slide presentation including a lecturer delivering a speech. A data 
stream generated by the audio-video recording unit 585 is captured for storage in a data file at 
data processing unit 560, col 10, lines 39-51). 

It should be note that Pan teaches the additional information of the media file is used in 
constructing the index file as showed in Fig. 2 (Le. a data set is maintained in an index file, col 
2, lines 11-26; The resulting event-data pointer record 152, (E.sub.i,j,P.sub.i,j,T.sub.i,j), is then 
stored in a data stream index file #1 235. There is usually one index file for each data stream. 
Pan, col 4, lines 34-39), wherein the data set of Pan comprises Event E (data sample of the 
claimed limitation), Pointer P (additional information of the claimed limitation), Timestamp T 
(additional information of the claimed limitation). 

The index file of Pan further comprises the offset values (Le. positional information, col 
1, line 59 to col 2, line 5) representing the location of each of the data samples in the media files 
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(i.e, positional information indicating where data associated with the events are located in a 
corresponding storage medium such as a digital file or where the data is located within the data 
stream, col 7, line 59 to col 2, line 5), 
Pan does not teach; 

the additional information of the media files being used in reconstructing the index file 
upon corruption of the index file, the reconstructed index file comprising the offset values 
representing the location of each of the data samples in the media files, wherein the reconstructed 
index file replaces the index file associated with the one or more media files. 

Lyle teaches: 

the additional information (7.e. additional information within a space map page in a LOB 
table space, col 4, line 60 to col 5, line 6) of the media files (le, LOB, Large objects, such as 
image data, col 2, lines 27-37) being used in reconstructing the index file (le, to recover an 
index on an auxiliary table by reading only the LOB low-level space map pages, col 4, line 60 to 
col 5, line 6) upon corruption of the index file (i,e, the index could be corrupted, col 2, lines 38- 
44), the reconstructed index file comprising the offset values (le. the index recovery system 124 
indicates for each page in the space map page whether that page is the first page allocated to a 
LOB, col 4, line 60 to col 5, line 6) representing the location of each of the data samples in the 
media files (le. The index recovery system 124 of the present invention includes additional 
information within a space map page in a LOB table space. In addition to recording whether a 
page is allocated or deallocated, the index recovery system 124 indicates for each page in the 
space map page whether that page is the first page allocated to a LOB, Storing this information 
with a LOB low-level space map page enables the index recovery system 124 to recover an index 
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on an auxiliary table by reading only the LOB low-level space map pages, instead of all pages in 
the LOB table space, col. 4, line 60 to col. 5, line 6). 

It should be noted that the claimed invention discloses using additional information such 
as image information to reconstruct the index file (said image information allows for 
reconstruction of said index file upon corruption thereof, See Application, [0017]). 

Similarly, Lyle teaches the using of additional information such as image information in 
order to rebuild the index. 

Thus, it would have been obvious to one of ordinary skill of the art having the teaching of 
Pan and Lyle at the time the invention was made to modify the system of Pan to include the 
limitations as taught by Lyle. One of ordinary skill in the art would be motivated to make this 
combination in order to recover an index on an auxiliary table in view of Lyle (col, 4, line 60 to 
col. 5, line 6), as doing so would give the added benefit of enabling the index recovery system 
124 to recover an index on an auxiliary table by reading only the LOB low-level space map 
pages, instead of all pages in the LOB table space as taught by Lyle (col. 4, line 60 to col. 5, line 
6). 

Pan, Lyle do not specifically teach the reconstructed index file replaces the index file 
associated with the one or more media files. 

Nunally teaches the step of updating the index information for video and audio files (i.e. 
the sequence is added to a positive result list (step 152) and the index information for the file is 
updated to indicate detection of the event (step 154). That is, the event-related data shown at 104 
in FIG. 5 is updated to indicate detection of the event, as well as the confidence factor applicable 
to the event detection decision, col. 10, lines 37-62; FIG. 5 illustrates a format in which 
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compressed video and audio data are stored on one or more of the hard disk drives of the 
analysis/storage device. As seen from FIG, 5, the data stored on the hard drives includes 
compressed video and audio data files indicated generally at 92 and index data indicated 
generally at 94, col 8, line 66 to col P, line 14), 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally at the time the invention was made to modify the system of Pan, Lyle to include 
the limitations as taught by Nunally. One of ordinary skill in the art would be motivated to make 
this combination in order to update the index information for video and audio files in view of 
Nunally (col. 10, lines 37-62), as doing so would give the added benefit of providing an 
integrated video and audio recording device with advanced information management capabilities 
as taught by Nunally (col. 1, lines 37-39). 

As per claim 40, Pan teaches a computer product comprising a computer readable 
medium having recorded thereon a computer program for storing data (le, video and audio data 
is stored on a hard disk, col 4, lines 58-65), said program comprising: 

code for storing data (i.e. video and audio data is stored on a hard disk, col 4, lines 58- 
65), as one or more data samples (le, a sequence of video and audio frames, col 3, lines 20-27; 
event el, ... event e6; event fl .... event f5; See Fig, 2), in one or more media files configured for 
use by a media player application (Le. a media file that can be played back through an 
application such as Microsoft Windows Media Player, col 3, lines 20-27) in playing the data 
samples (Le. a "data stream" is^a sequence of video and audio frames read from a media file that 
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can be played back through an application such as Microsoft Windows Media Player, col i, 
lines 20-27 )\ and 

code for storing in an index file associated with one or more of the media files (le. a data 

set is maintained in an index file, col 2, lines 11-26), at least an offset value (le, positional 

information, col 7, line 59 to col 2, line 5) for each of the data samples representing a location 

(le, positional information indicating where data associated with the events are located in a 

» 

corresponding storage medium such as a digital file or where the data is located within the data 
stream, col 7, line 59 to col 2, line 5) of each of the data samples in a corresponding one of the 
media files, each of the media files further comprising additional information (le, data pointer, 
time, See Fig. 2) interspersed throughout that media file (i.e. correlating data among multiple 
data streams based on a use of time-stamps and related positional information, col 1, lines 46- 
58; See Fig, 2), the additional information comprising at least a timestamp (le. the time-stamps 
are used as an index to locate where the data associated with the corresponding event is stored 
in the second data stream, col 2, lines 27-40) for each of the data samples (le, event el, ... event 
e6; event fl .... event p; See Fig. 2), each of the timestamps (i.e. tl, t3, tlO, t6, t8, til, t2, t4, t5, 
t7, t9; See Fig. 2) indicating a capture time of an associated data sample (i.e. During a 
presentation of information at slide display device 580, an audio-video recording unit 585 
captures details of, for example, a corresponding slide presentation including a lecturer 
delivering a speech A data stream generated by the audio-video recording unit 585 is captured 
for storage in a data file at data processing unit 560, col 10, lines 39-51). 

It should be note that Pan teaches the additional information of the media file is used in 
constructing the index file as showed in Fig. 2 (Le. a data set is maintained in an index file, col 
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2, lines 11-26; The resulting event-data pointer record 152, (KsubJj\P,subJj\T.subJj% is then 
stored in a data stream index file #1 235. There is usually one index file fi)r each data stream, 
Pan, col. 4, lines 34-39), wherein the data set of Pan comprises Event E (data sample of the 
claimed limitation), Pointer P (additional information of the claimed limitation), Timestamp T 
(additional information of the claimed limitation). 

The index file of Pan further comprises the offset values (i.e. positional information, col. 
1, line 59 to col 2, line 5) representing the location of each of the data samples in the media files 
(i.e. positional infi)rmation indicating where data associated with the events are located in a 
corresponding storage medium such as a digital file or where the, data is located within the data 
stream, col. 1, line 59 to col 2, line 5). 

Pan does not teach: 

the additional information of the media files being used in reconstructing the index file 
upon corruption of the index file, the reconstructed index file comprising the offset values 
representing the location of each of the data samples in the media files, wherein the reconstructed 
index file replaces the index file associated with the one or more media files. 

Lyle teaches: 

the additional information (i.e. additional infi)rmation within a space map page in a LOB 
table space, col 4, line 60 to col 5, line 6) of the media files (i.e. LOB, Large objects, such as 
image data, col 2, lines 27-37) being used in reconstructing the index file (i.e. to recover an 
index on an auxiliary table by reading only the LOB low-level space map pages, col 4, line 60 to 
col 5, line 6) upon corruption of the index file (i.e. the index could be corrupted, col 2, lines 38- 
44), the reconstructed index file comprising the offset values (le. the index recovery system 124 
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indicates for each page in the space map page whether that page is the first page allocated to a 
LOB, col. 4, line 60 to col. 5, line 6) representing the location of each of the data samples in the 
media files (i.e. The index recovery system 124 of the present invention includes additional 
information within a space map page in a LOB table space. In addition to recording whether a 
page is allocated or deallocated, the index recovery system 124 indicates for each page in the 
space map page whether that page is the first page allocated to a LOB, Storing this information 
with a LOB low-level space map page enables the index recovery system 124 to recover an index 
on an auxiliary table by reading only the LOB low-level space map pages, instead of all pages in 
the LOB table space, col. 4, line 60 to col 5, line 6). 

It should be noted that the claimed invention discloses using additional information such 
as image information to reconstruct the index file (i.e. said image information allows for 
reconstruction of said index file upon corruption thereof, See Application, [0017]). Similarly, 
Lyle teaches the using of additional information such as image information to rebuild the index. 

Thus, it would have been obvious to one of ordinary skill of the art having the teaching of 
Pan and Lyle at the time the invention was made to modify the system of Pan to include the 
limitations as taught by Lyle. One of ordinary skill in the art would be motivated to make this 
combination in order to recover an index on an auxiliary table in view of Lyle (col. 4, line 60 to 
col. 5, line 6), as doing so would give the added benefit of enabling the index recovery system 
124 to recover an index on an auxiliary table by reading only the LOB low-level space map 
pages, instead of all pages in the LOB table space as taught by Lyle (col. 4, line 60 to coL 5, line 
6). 
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Pan, Lyle do not fairly teach the reconstructed index file replaces the index file associated 
with the one or more media files. 

Nunally teaches the step of updating the index information for video and audio files (i.e. 
the sequence is added to a positive result list (step 152) and the index information for the file is 
updated to indicate detection of the event (step 154). That is, the event-related data shown at 104 
in FIG. 5 is updated to indicate detection of the events as well as the confidence factor applicable 
to the event detection decision, col 10, lines 37-62; FIG. 5 illustrates a format in which 
compressed video and audio data are stored on one or more of the hard disk drives of the 
analysis/storage device. As seen from FIG. 5, the data stored on the hard drives includes 
compressed video and audio data files indicated generally at 92 and index data indicated 
generally at 94, col 8, line 66 to col 9, line 14). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally at the time the invention was made to modify the system of Pan, Lyle to include 
the limitations as taught by Nunally. One of ordinary skill in the art would be motivated to make 
this combination in order to update the index information for video and audio files in view of 
Nunally (col. 10, lines 37-62), as doing so would give the added benefit of providing an 
integrated video and audio recording device with advanced information management capabilities 
as taught by Nunally (col. 1, lines 37-39). 

As per claim 41, a computer product comprising a computer readable medium having 
recorded thereon a computer program for storing video (le. video and audio data is stored on a 
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hard disk, col 4, lines 58-65) and associated text data (7.e. textual data stream, col, 11, lines 16- 
34), said program comprising: 

code for storing the video data (Le. video and audio data is stored on a hard disk, col 4, 
lines 58-65) associated text data (le, textual data stream, col 11, lines 16-34), as one or more 
data samples (le. a sequence of video and audio frames, col 3, lines 20-27; event el, ... event 
e6; event fl event f5: See Fig. 2), in one or more media files in accordance with a first file 
format (i.e. Data stream #1, Data stream #2 in Fig. 2; a digital file, col 1, line 59 to col 2, line 
5), each media file being configured for use by a media player application (i,e, a media file that 
can be played back through an application such as Microsoft Windows Media Player, col 3, 
lines 20-27) in playing the video data (i,e. a ''data stream" is a sequence of video and audio 
frames read from a media file that can be played back through an application such as Microsoft 
Windows Media Player, col 3, lines 20-27); 

code for storing, in an index file in accordance with a second file format (le. a data set is 
maintained in an index file, col 2, lines 11-26), at least an offset value (le. positional 
information, col 1, line 59 to col 2, line 5) for each of the data samples representing a location 
of each of the one or more data samples in a corresponding one of the media files (le, positional 
information indicating where data associated with the events are located in a corresponding 
storage medium such as a digital file or where the data is located within the data stream, col 1, 
line 59 to col 2, line 5)\ and 

code for adding (le, informational data set is generated and stored in an index file, 
Abstract) additional information (le, data pointer, time, See Fig, 2) interspersed throughout each 
of the media files (le. correlating data among multiple data streams based on a use of time- 
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stamps and related positional information, col 7, lines 46-58; See Fig. 2), the media file 
including the additional information being readable by the media player application 
corresponding at least to the first file format (i.e, a media file that can be played back through an 
application such as Microsoft Windows Media Player, col. 3, lines 20-27), the additional 
information comprising at least a timestamp (Le. the time-stamps are used as an index to locate 
where the data associated with the corresponding event is stored in the second data stream, col 
2, lines 27-40) for one or more data samples (le. event el, ... event e6; event fl .... event f5; See 
Fig. 2), each of the timestamps (le. tl, t3, tlO, t6, t8, til, t2, t4, t5, t7, t9; See Fig. 2) indicating a 
capture time of an associated data sample (le. During a presentation of information at slide 
display device 580, an audio-video recording unit 585 captures details of, for example, a 
corresponding slide presentation including a lecturer delivering a speech A data stream 
generated by the audio-video recording unit 585 is captured for storage in a data file at data 
processing unit 560, col 10, lines 39-51). 

It should be note that Pan teaches the additional information of the media file is used in 
constructing the index file as showed in Fig. 2 (i.e. a data set is maintained in an index file, col 
2, lines 11-26; The resulting event-data pointer record 152, (E.sub.i,j,P.sub.i,j\T,subJj), is then 
stored in a data stream index file #1 235. There is usually one index file for each data stream. 
Pan, col 4, lines 34-39), wherein the data set of Pan comprises Event E (data sample of the 
claimed limitation), Pointer P (additional information of the claimed limitation), Timestamp T 
(additional information of the claimed limitation). 

The index file of Pan further comprises the offset values (le. positional information, col 
1, line 59 to col 2, line 5) representing the location of each of the data samples in the media files 
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(Le, positional information indicating where data associated with the events are located in a 
corresponding storage medium such as a digital file or where the data is located within the data 
stream, col. 7, line 59 to col 2, line 5). 
Pan does not teach: 

the additional information of the media files being used in reconstructing the index file 
upon corruption of the index file, the reconstructed index file comprising the offset values 
representing the location of each of the data samples in the media files, wherein the reconstructed 
index file replaces the index file associated with the one or more media files. 

Lyle teaches: 

the additional information (i.e. additional information within a space map page in a LOB 
table space, col 4, line 60 to col J, line 6) of the media files (le. LOB, Large objects, such as 
image data, col 2, lines 27-37) being used in reconstructing the index file (i.e. to recover an 
index on an auxiliary table by reading only the LOB low-level space map pages, col 4, line 60 to 
col 5, line 6) upon corruption of the index file (i.e. the index could be corrupted, col 2, lines 38- 
44), the reconstructed index file comprising the offset values (le. the index recovery system 124 
indicates for each page in the space map page whether that page is the first page allocated to a 
LOB, col 4, line 60 to col 5, line 6) representing the location of each of the data samples in the 
media files (le. The index recovery system 124 of the present invention includes additional 
information within a space map page in a LOB table space. In addition to recording whether a 
page is allocated or deallocated, the index recovery system 124 indicates for each page in the 
space map page whether that page is the first page allocated to a LOB. Storing this information 
with a LOB low-level space map page enables the index recovery system 124 to recover an index 
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on an auxiliary table by reading only the LOB low-level space map pages, instead of all pages in 
the LOB table space, col 4, line 60 to col J, line 6), 

It should be noted that the Applicants invention discloses using additional information 
such as image information in order to reconstruct the index file (i.e. said image information 
allows for reconstruction of said index file upon corruption thereof, See Application, [0017]). 

Similarly, Lyle teaches the using of additional information such as image information in 
order to rebuild the index. 

Thus, it would have been obvious to one of ordinary skill of the art having the teaching of 
Pan and Lyle at the time the invention was made to modify the system of Pan to include the 
limitations as taught by Lyle. One of ordinary skill in the art would be motivated to make this 
combination in order to recover an index on an auxihary table in view of Lyle (col. 4, line 60 to 
col. 5, line 6), as doing so would give the added benefit of enabling the index recovery system 
124 to recover an index on an auxiliary table by reading only the LOB low-level space map 
pages, instead of all pages in the LOB table space as taught by Lyle (col. 4, line 60 to col. 5, line 

Pan, Lyle do not fairly teach the reconstructed index file replaces the index file associated 
with the one or more media files. 

Nunally teaches the step of updating the index information for video and audio files (i.e. 
the sequence is added to a positive result list (step 152) and the index information for the file is 
updated to indicate detection of the event (step 154), That is, the event-related data shown at 104 
in FIG, 5 is updated to indicate detection of the event, as well as the confidence factor applicable 
to the event detection decision, col 10, lines 37-62; FIG. 5 illustrates a format in which 
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compressed video and audio data are stored on one or more of the hard disk drives of the 
analysis/storage device. As seen from FIG. J, the data stored on the hard drives includes 
compressed video and audio data files indicated generally at 92 and index data indicated 
generally at 94, col 8, line 66 to col. 9, line 14), 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally at the time the invention was made to modify the system of Pan, Lyle to include 
the limitations as taught by Nunally. One of ordinary skill in the art would be motivated to make 
this combination in order to update the index information for video and audio files in view of 
Nunally (col. 10, lines 37-62), as doing so would give the added benefit of providing an 
integrated video and audio recording device with advanced information management capabilities 
as taught by Nunally (col. 1, lines 37-39). 

As to claims 2, 23, Lyle teaches the additional information is used exclusively for 
reconstruction of the index file (le. to recover an index on an auxiliary table by reading only the 
LOB low-level space map pages, col 4y line 60 to col 5, line 6). 

As to claims 7, 28, Pan teaches the additional information comprises a resolution of an 
associated sample (Le. The consequences of latency depend upon the application and the desired 
time resolution at which queries are being made, col 12, lines 46-55), 

As to claims 8, 29, Pan teaches the information of the index file comprises frame rate 
variation information (i.e. video rate of 30 frames per second, col 11, line 58 to col 12, line 2). 
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As to claims 9, 30, Pan teaches the additional information is stored as one or more 
dedicated samples of the media file (Le. FIG, 3 is a graph of sample trigger events as recorded 
over time according to sample data in the table of FIG, 2 According to the principles of the 
present invention, events in one data file are indexed to events in a second data file based on 
time-stamps and corresponding data pointers, col. 7, lines 10-14), 

As to claims 10, 31, Nunally teaches the media file is configured in accordance with the 
Microsoft AVI file fonnat (le. Both the video data and the audio data are stored in an 
audio/video interleave (AVI) format, col 8, line 66 to col 9, line 14). 

As per claim 12, Pan teaches the data is video data (le. video frames, col 11, lines 45- 

52), 

As per claim 13, Pan teaches the data is text data (i,e. textual data stream, col 11, lines 

16-34), 

As per claim 14, Pan teaches the data is video data and associated text data (le, closed 
captions for video or audio content, col II, lines 16-23), 

As to claims 15, 33, Pan teaches the video and associated text data are captured for 
security purposes (le. The principles of the present invention have applications beyond note 
taking, text entry, or a close captioning system. One example is a video surveillance system for 
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an automobile parking lot. This example system uses multiple video cameras. One set of cameras 
record the automobiles and associated license plates at the entrance and exits. Another set of 
cameras record the parking area. In current video surveillance systems, cameras continuously 
record video on tape. This results in a waste of video recording media. A more efficient system 
would record, for example, only for a few seconds after a motion detector indicates when a car 
has entered or left the garage or parking space. This type of sporadic recording renders it 
difficult to determine where an event is recorded on a videotape. Even a time-stamped videotape 
must be searched for the appropriate time match, col. 13, line 62 to col. 14, line 9). 

As per claim 17, Nunally teaches a plurality of copies of a corresponding text string are 
included in each text sample of the media file (i.e. sound, image or closed-captioning analysis 
may be applied to a previously-recorded signal reproduced from the storage device 326 and 
routed to the analysis circuit 324 via a signal path 330, col. 16, line 32 to col. 1 7, line 2). 

As per claim 18, Nunally teaches a first copy of the text string (i.e. sound, image or 
closed-captioning analysis may be applied to a previously-recorded signal reproduced from the 
storage device 326 and routed to the analysis circuit 324 via a signal path 330, col. 16, line 32 to 
col. 1 7, line 2) is configured in accordance with the AVI file format (i.e. Both the video data and 
the audio data are stored in an audio/video interleave (A VI) format, col. 8, line 66 to col. 9, line 
14), 
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6. Claims 1 1, 16, 19, 32 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pan 
et al. (US Patent No. 6,993,246), in view of Lyle (US Patent No. 6,470,359), in view of Nunally 
et al. (US Patent No. 6,035,341), and further in view of Otsuka et al. (US Patent No. 6,065,010). 

As to claims 11, 32, Pan, Lyle, Nunally do not teach the index file is configured in 
accordance with the Apple QuickTime file format. 

Otsuka teaches the index file is configured in accordance with the Apple QuickTime file 
format (i.e. the data of the scenes can be recorded in a number of different formats including: the 
Motion Picture Experts Group (MPEG) format; the Quicktime format; or the Joint Photographic 
Experts Group (JPEG) format, col 5, line 49 to col 6, line 2). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally, Otsuka at the time the invention was made to modify the system of Pan, Lyle, 
Nunally to include the limitations as taught by Otsuka. One of ordinary skill in the art would be 
motivated to make this combination in order to define virtual files, each virtual file is associated 
with a separate individual data of a group of data within a physical file in view of Otsuka (coL 6, 
lines 3-15), as doing so would give the added benefit of the data of accessing the virtual file 
rapidly and efficiently accessed without the need to search through the physical file for it as 
taught by Otsuka (col. 6, lines 3-15). 

As per claim 16, Pan, Lyle, Nunally do not teach each video sample is a separate JPEG 

file. 
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Otsuka teaches this limitation (i.e. the data of the scenes can be recorded in a number of 
different formats including: the Motion Picture Experts Group (MPEG) format; the Quicktime 
format; or the Joint Photographic Experts Group (JPEG) format, col 5, line 49 to col 6, line 2). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally, Otsuka iat the time the invention was made to modify the system of Pan, Lyle, 
Nunally to include the limitations as taught by Otsuka. One of ordinary skill in the art would be 
motivated to make this combination in order to define virtual files, each virtual file is associated 
with a separate individual data of a group of data within a physical file in view of Otsuka (col. 6, 
lines 3-15), as doing so would give the added benefit of accessing the data of the virtual file 
rapidly and efficiently accessed without the need to search through the physical file for it as 
taught by Otsuka (col. 6, lines 3-15). 

As per claim 19, Pan, Lyle, Nunally do not teach a second copy of the text string is 
configured in accordance with the QuickTime file format. 

Otsuka teaches this limitation (Le, the data of the scenes can be recorded in a number of 
different formats including: the Motion Picture Experts Group (MPEG) format; the Quicktime 
format; or the Joint Photographic Experts Group (JPEG) format, col .5, line 49 to col 6, line 2). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally, Otsuka at the time the invention was made to modify the system of Pan, Lyle, 
Nunally to include the limitations as taught by Otsuka. One of ordinary skill in the art would be 
motivated to make this combination in order to define virtual files, each virtual file is associated 
with a separate individual data of a group of data within a physical file in view of Otsuka (col. 6, 
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lines 3-15), as doing so would give the added benefit of accessing the data of the virtual file 
rapidly and efficiently without the need to search through the physical file for it as taught by 
Otsuka (col. 6, lines 3-15). 

7. Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Pan et al. (US 
Patent No. 6,993,246), in view of Lyle (US Patent No. 6,470,359), in view of Nunally et al. (US 
Patent No. 6,035,341), and further iri view of Gutfreund et al. (US Patent No. 6,665,835). 

As per claim 20, Pan, Lyle, Nunally do not teach the step of inserting one or more empty 
samples into the media file to compensate for any missed samples. 

Gutfi-eund teaches this limitation (Le. A reference for the timer concerning where in the 
video stream the event occurs is maintained by creating a series of predetermined time stamps in 
the video stream. That is, a time stamp is created every second with no component or event 
associated therewith. The granularity of such predetermined time stamps is determined 
according to the specific application requirements, col 8, line 61 to col 8, line 14). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally, Gutfreund at the time the invention was made to modify the system of Pan, Lyle, 
Nunally to include the limitations as taught by Gutfreund. One of ordinary skill in the art would 
be motivated to make this combination in order to create a series of predetermined time stamp in 
the video stream in view of Gutfreund (col. 8, line 61 to col. 8, line 14), as doing so would give 
the added benefit of providing a real-time inultimedia joumaling application that is editable by a 
user to add other synchronized events as taught by Gutfreund (col. 2, lines 34-36). 
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8. Claim 21 is rejected under 35 U.S.C. 103(a) as being unpatentable oyer Pan et al. (US 
Patent No. 6,993,246), in view of Lyle (US Patent No. 6,470,359), in view of Nunally et al. (US 
Patent No. 6,035,341), and further in view of Abbott et al. (US Patent No. 6,654,933). 

As per claim 21, Pan, Lyle, Nunally do not teach the index file contains a track 
referencing at least the media file. 

Abbott teaches this limitation (Le. the audio and video tracks of a movie, col. 5, lines 3- 

27). 

It would have been obvious to one of ordinary skill of the art having the teaching of Pan, 
Lyle, Nunally, Abbott at the time the invention was made to modify the system of Pan, Lyle, 
Nunally to include the limitations as taught by Abbott. One of ordinary skill in the art would be 
motivated to make this combination in order to encode the audio and video tracks and store in a 
file in view of Abbott (col. 4, lines 3-27), as doing so would give the added benefit of 
synchronization method including constructing a base atom index file that contains base atom 
index boundaries as taught by Abbott (col. 2, lines 45-54). 

Response to Arguments 

9. Applicant's arguments filed 1 1/27/2007 have been fully considered but they are not 
persuasive. 

a. Pan does not teach/suggest inventive features of independent claim 1, such as 
^^each of the media files further comprising additional information interspersed throughout 
that media file, the additional information comprising at least a timestamp for one or more 
of the data samples." 
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storing data equates to "The resulting event-data pointer record is then stored in a data 
stream index file ''' of Pan (See col. 4, lines 34-49). Furthermore, Pan discloses the video and 
audio data is stored on a hard disk in order to play back (See col. 4, lines 58-65). 

data samples equates to a sequence of video and audio frames (col. 3, lines 20-27), or a 
set of events (col 3, line 62 to col. 4, line 4; See Fig. 2). 

media files equates to Data stream #7, Data stream #2 in Fig. 2 or a digital file of Pan, 
See col. 1, line 59 to col. 2, line 5 (i.e. positional information indicating where data associated 
with the events are located in a corresponding storage medium such as a digital file or where the 
data is located within the data stream, col 7, line 59 to col 2, line 5). 

a media player application equates to Microsoft Windows Media Player of Pan in col. 3, 
lines 20-27 (i.e. a "data stream" is a sequence of video and audio frames read from a media file 
that can be played back through an application such as Microsoft Windows Media Player, See 
Pan, col. 3, lines 20-27). 

b. Pan does teach/suggest inventive features of independent claim 1, such as ^^each of 
the media files further comprising additional information interspersed throughout that 
media file, the additional information comprising at least a timestamp for one or more of 
the data samples.'' 

additional information equates to Ptr, time of Pan in Fig. 2. 

It should be noted that the time T of Pan is a unique time stamp T to each event, See col. 
4, lines 34-39 (i.e. Sequences of event-data pointer pairs form the inputs to event-data pointer 
logger 250. The logger assigns a unique time stamp TiJ to each pair (EAj.P.ij). The resultin2 
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event-data pointer record 152. (EU.PAj.TU), is then stored in a data stream index file #1 235 , 
There is usually one index file for each data stream, Pan, col, 4, lines 34-39). 

media files equates to Data stream #7, Data stream #2 in Fig. 2 of Pan. 

additional information interspersed throughout that media file as sliowen in Fig. 2 of 
Pan, e.g. t2, t4, t5, t7, t9 are interspersed throughout in data stream #2 (See Fig. 2). 
10. Applicants have amended the independent claim 1, 22, 37, 38, 40, 41 to recite "the 
reconstructed index file replaces the index file associated with the one or more media files" to 
amplify the distinctions between claimed invention and the cited arts; however, upon further 
search and consideration, a new ground(s) of rejection is made in view of newly found prior art. 
Arguments are moot in view of new grounds of rejections. 



1 1 . The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Miranda Le whose telephone number is (571) 272-41 12. The 
examiner can normally be reached on Monday through Friday from 8:30 AM to 5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John R. Cottingham, can be reached on (571) 272-7079. The fax number to this Art 
Unit is (571)-273-8300. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group receptionist whose telephone number is (571) 272-2100. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov . Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Conclusion 




Miranda Le 
February 09, 2008 



